Calibration, Recognition, and Shape from Silhouettes of Stones
نویسندگان
چکیده
Multi-view shape-from-silhouette systems are increasingly used for analysing stones. This thesis presents methods to estimate stone shape and to recognise individual stones from their silhouettes. Calibration of two image capture setups is investigated. First, a setup consisting of two mirrors and a camera is introduced. Pose and camera internal parameters are inferred from silhouettes alone. Second, the configuration and calibration of a high throughput multi-camera setup is covered. Multiple silhouette sets of a stone are merged into a single set by inferring relative poses between sets. This is achieved by adjusting pose parameters to maximise geometrical consistency specified by the epipolar tangency constraint. Shape properties (such as volume, flatness, and elongation) are inferred more accurately from the merged silhouette sets than from the original silhouette sets. Merging is used to recognise individual stones from pairs of silhouette sets captured on different occasions. Merged sets with sufficient geometrical consistency are classified as matches (produced by the same stone), whereas inconsistent sets are classified as mismatches. Batch matching is determining the one-to-one correspondence between two unordered batches of silhouette sets of the same batch of stones. A probabilistic framework is used to combine recognition by merging (which is slow, but accurate) with the efficiency of computing shape distribution-based dissimilarity values. Two unordered batches of 1200 six-view silhouette sets of uncut gemstones are correctly matched in approximately 68 seconds (using a 3.2GHz Pentium 4 machine). An experiment that compares silhouette-based shape estimates with mechanical sieving demonstrates an application using the developed methods. A batch of 494 garnets is sieved 15 times. After each sieving, silhouette sets are captured for sub-batches in each bin. Batch matching is used to determine the 15 sieve bins per stone. Better estimates of repeatability, and better understanding of the variability of the sieving process is obtained than if only histograms (the natural output of sieving) were considered. Silhouette-based sieve emulation is found to be more repeatable than mechanical sieving.
منابع مشابه
Shape from Silhouette Consensus
Many applications in computer vision require the 3D reconstruction of a shape from its different views. When the available information in the images is just a binary mask segmenting the object, the problem is called shape from silhouette (SfS). As first proposed by Baumgart [1], the shape is usually computed as the maximum volume consistent with the given set of silhouettes. This is called visu...
متن کاملDeep Shape from Silhouettes
Despite strong progress in the field of 3D reconstruction from multiple views, challenges from noise, transparencies and lack of texture remain. On the other hand, silhouette based reconstruction techniques ease the dependency of 3d reconstruction on image observations but need a large number of silhouettes as well as calibration information. In this paper, a novel end to end pipeline is propos...
متن کاملSilhouettes for Calibration and Reconstruction from Multiple Views
SUDIPTA N. SINHA: Silhouettes for Calibration and Reconstruction from Multiple Views. (Under the direction of Marc Pollefeys) In this thesis, we study how silhouettes extracted from images and video can help with two fundamental problems of 3D computer vision namely multi-view camera calibration and 3D surface reconstruction from multiple images. First, we present an automatic method for calibr...
متن کاملStructure and Motion from Silhouettes
Silhouettes (or outlines) are often a dominant image feature, and can be extracted relatively easily and reliably. They provide rich information about both the shape and motion of an object, and are indeed the only information available in the case of smooth textureless surfaces. Nonetheless, due to the viewpoint dependence of silhouettes, they do not readily provide point correspondences, and ...
متن کاملShape from inconsistent silhouette
Shape from Silhouette (SfS) is the general term used to refer to the techniques that obtain a volume estimate from a set of binary images. In a first step, a number of images are taken from different positions around the scene of interest. Later, each image is segmented to produce binary masks, also called silhouettes, to delimit the objects of interest. Finally, the volume estimate is obtained...
متن کامل